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Abstract — Quadratic invariance is a condition which has been 
shown to allow for optimal decentralized control problems to be 
cast as convex optimization problems. The condition relates the 
constraints that the decentralization imposes on the controller to 
the structure of the plant. In this paper, we consider the problem 
of finding the closest subset and superset of the decentralization 
constraint which are quadratically invariant when the original 
problem is not. We show that this can itself be cast as a convex 
problem for the case where the controller is subject to delay 
constraints between subsystems, but that this fails when we only 
consider sparsity constraints on the controller. For that case, we 
develop an algorithm that finds the closest superset in a fixed 
number of steps, and discuss methods of finding a close subset. 



I. Introduction 

The design of decentralized controllers has been of interest 
for a long time, as evidenced in the surveys (T], j2), and 
continues to this day with the advent of complex intercon- 
nected systems. The counterexample constructed by Hans 
Witsenhausen in 1968 [3] clearly illustrates the fundamental 
reasons why problems in decentralized control are difficult. 

Among the recent results in decentralized control, new 
approaches have been introduced that are based on alge- 
braic principles, such as the work in PJ-||6). Very relevant 
to this paper is the work in pi, J3J, which classified the 
problems for which optimal decentralized synthesis could be 
cast as a convex optimization problem. Here, the plant is 
linear, time-invariant and it is partitioned into dynamically 
coupled subsystems, while the controller is also partitioned 
into subcontrollers. In this framework, the decentralization 
being imposed manifests itself as constraints on the controller 
to be designed, often called the information constraint. 

The information constraint on the overall controller specifies 
what information is available to which controller. For instance, 
if information is passed between subsystems, such that each 
controller can access the outputs from other subsystems after 
different amounts of transmission time, then the information 
constraints are delay constraints, and may be represented by 
a matrix of these transmission delays. If instead, we consider 
each controller to be able to access the outputs from some 
subsystems but not from others, then the information constraint 
is a sparsity constraint, and may be represented by a binary 
matrix. 

Given such pre-selected information constraints, the exis- 
tence of a convex parameterization for all stabilizing con- 
trollers that satisfy the constraint can be determined via the 
algebraic test introduced in pj, (5), which is denoted as 

M.C. Rotkowitz is with the Department of Electrical and Electronic 
Engineering, The University of Melbourne, Parkville VIC 3010 Australia, 
mcrotk@unimelb . edu . au 

N.C. Martins is with the Department of Electrical and Computer Engi- 
neering and the Institute for Systems Research, The University of Maryland, 
College Park MD 20740 USA, nma r t i n s @ umd . e du 



quadratic invariance. In contrast with prior work, where the 
information constraint on the controller is fixed beforehand, 
this paper addresses the design of the information constraint 
itself. More specifically, given a plant and a pre-selected 
information constraint that is not quadratically invariant, we 
give explicit algorithms to compute the quadratically invariant 
information constraint that is closest to the pre-selected one. 
We consider finding the closest quadratically invariant super- 
set, which corresponds to relaxing the pre-selected constraints 
as little as possible to get a tractable decentralized control 
problem, which may then be used to obtain a lower bound on 
the original problem, as well as finding the closest quadrat- 
ically invariant subset, which corresponds to tightening the 
pre-selected constraints as little as possible to get a tractable 
decentralized control problem, which may then be used to 
obtain upper bounds on the original problem. 

We consider the two particular cases of information con- 
straint outlined above. In the first case, we consider constraints 
as transmission delays between the output of each subsystem 
and the subcontrollers that are connected to it. The distance 
between any two information constraints is quantified via a 
norm of the difference between the delay matrices, and we 
show that we can find the closest quadratically invariant set, 
superset, or subset as a convex optimization problem. 

In the second case, we consider sparsity constraints that 
represent which controllers can access which subsystem out- 
puts, and represent such constraints with binary matrices. The 
distance between information constraints is then given by the 
hamming distance, applied to the binary sparsity matrices. We 
provide an algorithm that gives the closest superset; that is, the 
quadratically invariant constraint that can be obtained by way 
of allowing the least number of additional links, and show that 
it terminates in a fixed number of iterations. For the problem of 
finding a close set or subset, we discuss some heuristic-based 
solutions. 



Paper organization: Besides the introduction, this paper 
has six sections. Section [n] presents the notation and the 
basic concepts used throughout the paper. The delay and 
sparsity constraints adopted in our work are described in detail 
in Section 



III while their characterization using quadratic 



invariance is given in Section IV The main problems ad 



dressed in this paper are formulated and solved in Section \V\ 
Section [VT] briefly notes how this work also applies when 
assumptions of linear time-invariance are dropped, numerical 



examples are given in Section VII and conclusions are given 
in Section IVIlTl 
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II. Preliminaries 

Throughout the paper, we adopt a given causal linear time- 
invariant continuous-time plant P partitioned as follows: 

Pn P\2 
P21 G 

Here, P E ^^+"-) x ; where K qxr denotes the set 

of matrices of dimension q by r, whose entries are proper 
transfer functions of the Laplace complex variable s. Note 
that we abbreviate G = P22, since we will refer to that block 
frequently, and so that we may refer to its subdivisions without 
ambiguity. 

Given a causal linear time-invariant controller K in 
TZp uXTly , we define the closed-loop map by 



f(P,K) d = f P n 



P 12 K(I-GK)- 1 P 2l 



where we assume that the feedback interconnection is well 
posed. The map f(P, K) is also called the (lower) linear frac- 
tional transformation (LFT) of P and K. This interconnection 
is shown in Figure [T] 



Pll 


P12 


P21 


G 



w 



K 



Fig. 1. Linear fractional interconnection of P and K 

We suppose that there are n y sensor measurements and 
n u control actions, and thus partition the sensor measurements 
and control actions as 



y = [vT 



yl y ] u = [uj 

and then further partition G and K as 



G 



Gi 



K 



Kir 



Kn 



Given A S IR mxn , we may write A in term of its columns 

as 

A = [at ... an] 
and then associate a vector vec(^4) 6 M. mn defined by 

vec(A) d H[al ■■■ a^f 
Further notation will be introduced as needed. 

A. Delays 

We define Delay(-) for a causal operator as the smallest 
amount of time in which an input can affect its output. For 



any causal linear time-invariant operator H : C e — > C e , its 
delay is defined as: 

Delay(JJ) d = inf{r > | z(t) £ 0, z = H(w),w E C e , 

where w(t) = , t < 0} 

and if H = 0, we consider its delay to be infinite. Here C e 
is the domain of H, which can be any extended p-normed 
Banach space of functions of non-negative continuous time 
with co-domain in the reals. 

If the map H has a well defined impulse response function 
h, then the delay of H can be expressed as: 

Delay(£0 = mf{r > | h{r) ^ 0} 

B. Sparsity 

We adopt the following notation to streamline our use of 
sparsity patterns and sparsity constraints. 

1) Binary algebra: Let B = {0,1} represent the set of 
binary numbers. Given x,y EM, we define the following basic 
operations: 



x + y 



dg I 0, if x = y = 

[ 1, otherwise 

def fl, i£x = y=l 

I 0, otherwise 



x,y E 



x,yE 



Given X,Y E M mxn , we say that X < Y holds if and only 
if Xij < Yij for all i, j satisfying 1 < i < m and 1 < j < n, 
where X^ and Y^ are the entries at the i-th row and j-th 
column of the binary matrices X and Y, respectively. 

Given X, Y, Z E B mx ", these definitions lead to the 
following immediate consequences: 

Z = X + Y => Z>X (1) 
X + Y = X^Y<X (2) 
X < Y, Y < X X = Y (3) 

Given X E B mx ™, we use the following notation to 
represent the total number of nonzero indeces in X: 

m n 

JV(X) d = f ^2^2X l:j , XEB mxn 

i=l j=l 

with the sum taken in the usual way. 

2) Sparsity patterns: Suppose that A hm E B mxn is a binary 
matrix. The following is the subspace of lZ 7 p Xn comprising the 
transfer function matrices that satisfy the sparsity constraints 
imposed by A bm : 

Sparse (A hin ) d = {B E TZ p nxn \ SyO'w) = for all i,j 

such that A\f = for almost all wel}. 

def 

Conversely, given B E W v nxn ', we define Pattern(S) = 
A bln , where A hm is the binary matrix given by: 



A 



bin 



0, if Bij(juj) — for almost all w E 

1, otherwise 



for i G {!,.. . ,m}, j E {1, . . .,n}. 
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III. Optimal Control Subject to Information 
Constraints 

In this section, we give a detailed description of the two 
main types of information constraints adopted in this paper, 
namely, delay constraints and sparsity constraints. 

A. Delay constraints 

Consider a plant comprising multiple subsystems which 
may affect one another subject to propagation delays, and 
which may communicate with one another with given trans- 
mission delays. In what follows, we give a precise definition 
of these types of delays. 

1) Propagation Delays: For any pair of subsystems i and 
j, we define the propagation delay p^ as the amount of time 
before a controller action at subsystem j can affect an output 
at subsystem i, as such: 

Pij = Delay(Gij), 

for all i € {1,.. -,n y }, j E {1, . . . ,n u }. 

2) Transmission Delays: For any pair of subsystems k and 
I, we define the (total) transmission delay tjy as the minimum 
amount of time before the controller of subsystem k may use 
outputs from subsystem I. Given these constraints, we can 
define the overall subspace of admissible controllers S such 
that K E S if and only if the following holds: 

Delay (K k i) > t kh 

for all k 6 {1, . . . , n u }, I 6 {1, . . . , n y }. 

B. Sparsity Constraints 

We now introduce the other main class of constraints we will 
consider in this paper, where each control input may access 
certain sensor measurements, but not others. 

We represent sparsity constraints on the overall controller 
via a binary matrix K hm E B nttX:n *. j ts en t]-i es can be 
interpreted as follows: 



1, if control input k 

may access sensor measurement I, 
0, if not, 



for all k E {1, . . . , n u }, I £ {1, ... , n y }. 

The subspace of admissible controllers can be expressed as: 

S = Sparse(^ hin ). 

From the quadratic invariance test introduced in (4), |5j, we 
find that the relevant information about the plant is its sparsity 
pattern G bln , obtained from: 

G bin = Pattern(G) 

where G bln is interpreted as follows: 



1, if control input j 

affects sensor measurement i, 
0, if not, 



C. Optimal Control Design Via Convex Programming 

Given a generalized plant P and a subspace of appropriately 
dimensioned causal linear time-invariant controllers S, the 
following is a class of constrained optimal control problems: 

minimize \\f(P, K)\\ 

subject to K stabilizes P (4) 

K E S 

Here || || is any norm on the closed-loop map chosen to 
encapsulate the control performance objectives. The delays 
associated with dynamics propagating from one subsystem to 
another, or the sparsity associated with them not propagating 
at all, are embedded in P. The subspace of admissible con- 
trollers, S, has been defined to encapsulate the constraints on 
how quickly information may be passed from one subsystem 
to another (delay constraints) or whether it can be passed at all 
(sparsity constraints). We call the subspace S the information 
constraint. 

Many decentralized control problems may be expressed in 
the form of problem (Q, including all of those addressed in [4|, 
(7), JSj. In this paper, we focus on the case where S is defined 
by delay constraints or sparsity constraints as discussed above. 

This problem is made substantially more difficult in general 
by the constraint that K lie in the subspace S. Without this 
constraint, the problem may be solved with many standard 
techniques. Note that the cost function ||/(P, K)\\ is in general 
a non-convex function of K. No computationally tractable 
approach is known for solving this problem for arbitrary P 
and S. 

IV. Quadratic Invariance 

In this section, we define quadratic invariance, and we give 
a brief overview of related results, in particular, that if it holds 
then convex synthesis of optimal decentralized controllers is 
possible. 

Definition 1: Let a causal linear time-invariant plant, repre- 
sented via a transfer function matrix G in lZp yXnu , be given. 
If S is a subset of TZp uXUy then S is called quadratically 
invariant under G if the following inclusion holds: 

KGK E S for all K E S. 

It was shown in [4] that if S is a closed subspace and S is 
quadratically invariant under G, then with a change of vari- 
ables, problem Q is equivalent to the following optimization 
problem 

minimize ||Ti - T 2 QT 3 II 



subject to Q E TZHc 
QES 



(5) 



for all % E {1, ...,n y }, j E {!,..., n„}. 



where T\ , T% , T3 E IZHoo ■ Here IZHoo is used to indicate that 
T\, T2, T3 and Q are proper transfer function matrices with 
no poles in C+ (stable) . 

The optimization problem in Q is convex. We may solve 
it to find the optimal Q, and then recover the optimal K 
for our original problem as stated in fjY If the norm of 
interest is the T^-norm, it was shown in [4] that the problem 



4 



can be further reduced to an unconstrained optimal control 
problem and then solved with standard software. Similar 
results have been achieved Q for function spaces beyond C e 
as well, also showing that quadratic invariance allows optimal 
linear decentralized control problems to be recast as convex 
optimization problems. 

The main focus of this paper is thus characterizing infor- 
mation constraints S which are as close as possible to a pre- 
selected one, and for which S is quadratically invariant under 
the plant G. 

A. QI - Delay Constraints 

For the case of delay constraints, it was shown in [9] that a 
necessary and sufficient condition for quadratic invariance is 



tki + Pij + tjl > tjy, 



(6) 



for all i, I 6 {1, . . . , n y }, and all j, k € {1, . . . , n u }. 

Note that it was further shown in |9] that if we consider 
the typical case of n subsystems, each with its own controller, 
such that n = n y = n u , and if the transmission delays satisfy 
the triangle inequality, then the quadratic invariance test can 
be further reduced to the following inequality: 



Pij ^ t{j : 



(7) 



for all i, j € {1, . . . , n}; that is, the communication between 
any two nodes needs to be as fast as the propagation between 
the same pair of nodes. 

B. QI - Sparsity Constraints 

For the case of sparsity constraints, it was shown in [4| that 
a necessary and sufficient condition for quadratic invariance is 



Kg G\f Kf (1 - Klf) = 0, 



(8) 



for all i, I 6 {1, . . . , n y }, and all j, k € {1, ... , n„}. 

It can be shown that this is equivalent to Condition (|6]l if 
we let 



if Klf 



(9) 



for all k G {1, . . . , n u }, and alH G {!,..., n y }, and let 



Pij 



R, ifG^f 

2<bin 

ij 



0, if G 



(10) 



for all i 6 {1, . . . , n y }, and all j £ {1, . . . ,n u }, for any 
R > 0, the interpretation being that a sparsity constraint can be 
thought of as a large delay, and a lack thereof can be thought 
of as no delay. 

V. Closest QI Constraint 

We now address the main question of this paper, which 
is finding the closest constraints when the above conditions 
fail; that is, when the original problem is not quadratically 
invariant. 



A. Closest - Delays 

Suppose that we are given propagation delays {p~ij}™Z'ij=i 
and transmission delays {tki}k=ii=v and that they do not 
satisfy Condition ((SJ. The problem of finding the closest 
constraint set, that is, the transmission delays {tkiYk=ii=i tnat 
are closest to {£fci}fe^'"" = i while satisfying |6]), can be set up 
as follows: 



minimize 

t 



||vec(i-i)|| 

subject to tki + Pij + tjl > hi, 
tu > 0, 



V»,j,M, < n > 

V k,l. 



This is a convex optimization problem in the new transmis- 
sion delays t. The norm is arbitrary, and may be chosen to 
encapsulate whatever notion of closeness is most appropriate. 
If the 1-norm is chosen, corresponding to minimizing the sum 
of the differences in transmission delays, or the oo-norm is 
chosen, corresponding to minimizing the largest difference, 
then the problem may be cast as a linear program (LP). 

If we want to find the closest quadratically invariant set, 
which is a superset of the original set, so that we may obtain 
a lower bound to the solution of the main problem then 
we simply add the constraint tki < tki for all k, I, and the 
problem remains convex (or remains an LP). Note that if we 
follow the aforementioned procedure and choose the 1-norm, 
then the objective is equivalent to maximizing the total delay 

sum Efe=iErii*fe«- 

Similarly, if we want to find the closest quadratically 
invariant set which is a subset of the original set, so that 
we may obtain an upper bound to the solution of the main 
problem (ffl, then we simply add the constraint tki > tki 
for all k, I, and the problem remains convex (or remains an 
LP). For this procedure and if we choose the 1-norm, then 
the objective is equivalent to minimizing the total delay sum 

fe=l 1^1=1 L kl- 



B. Closest - Sparsity 

Now suppose that we want to construct the closest quadrat- 
ically invariant set, superset, or subset, defined by sparsity 
constraints. We can recast a pre-selected sparsity constraint 
on the controller K bm and a given sparsity pattern of the plant 
G hm as in (|9"l),(fT0]i, and then set up problem ( fTTj ). The only 
problem is that for the resulting solution to correspond to 
a sparsity constraint, we need to add the binary constraints 
tki £ {0, R} for all k, I, and this destroys the convexity of the 
problem. 

1) Sparsity Superset: Consider first finding the closest 
quadratically invariant superset of the original constraint set; 
that is, the sparsest quadratically invariant set for which all of 
the original connections yi — > u& are still in place. 

This is equivalent to solving the above problem ( ffT| with 
tki < tki for a U k, I, and with the binary constraints, an 
intractable combinatorial problem, but we present an algorithm 
which solves it and terminates in a fixed number of steps. 
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We can write the problem as 



minimize 



M{Z) 



subject to ZG bin Z < Z 



(12) 



K° 



< Z 



where additions and multiplications are as defined for the 
binary algebra in the preliminaries, and where we will wish to 
use the information constraint S = Sparse(Z). The objective 
is defined to give us the sparsest possible solution, the first 
constraint ensures that the constraint set associated with the 
solution is quadratically invariant with respect to the plant, 
and the last constraint requires the resulting set of controllers 
to be able to access any information that could be accessed 
with the original constraints. Let the optimal solution to this 
optimization problem be denoted as Z* £ B n " xn! '. 

Define a sequence of sparsity constraints {Z m £ 

B «„xn^ m g N j giyen by 



z 



K 



bin 



-l — Z m + Z 7n G^ m Z m , m > 



(13) 
(14) 



again using the binary algebra. 

Our main result will be that this sequence converges to Z* , 
and that it does so in log 2 n iterations. We first prove several 
preliminary lemmas, and start with a lemma elucidating which 
terms comprise which elements of the sequence. 

Lemma 2: 

2 m -l 

Z m = K bm {G bm K hia y V m £ N (15) 

s=0 

Proof: For m = 0, this follows immediately from ( |13) . 
We then assume that ( fT5| holds for a given m E N, and 
consider m + 1. Then, 



Z rn+1 = J2 K h ' m {G hm K hm y 



i=0 



^ y ^bin ^^fbin j^-bin^k J £^bin | ^ y ^bin^^bin^bin^Z 



fe=0 



1=0 



All terms on the R.H.S. are of the form K bin (G bin K hin ) s for 
various s £ N. Choosing < i < 2 m — 1 gives < s < 
2 m - 1, and choosing k = 2 m - 1 with < I < 2 m - 1 
gives 2 m < s < (2 m - 1) + 1 + (2 m - 1) = 2 m+1 - 1. This 
last term is the highest order term, so we then have Z m+ i = 
E^cT -1 K hin {G hin K bin ) s and the proof follows by induction. 

■ 

We now give a lemma showing how many of these terms 
need to be considered. 

Lemma 3: The following holds for n = mm{n y ,n u }: 



K hin (G hin K bin ) r < ^ J ftT bin (G bin if bin ) s V reN. (16) 

Proof: Follows immediately from ([TJ for r < n — 1. Now 
consider r > n, k £ {1, . . . , n u }, I £ {1, . . . , n y }. Then 
[^ bm (G bm ^ bm )1« - E K^GfXK^G^ ■ ■ ■ G^K^ 



where the sum is taken over all possible i a £ {1, . . . ,n y } and 



j a £ {1, ... ,n u }. Consider an arbitrary such summand term 
that is equal to 1, and note that each component term must be 
equal to 1. 

If n = n y (i), then by the pigeonhole principle either 3a s.t. 
i a = I (i.a), or 3a, (5, with a //3, s.t. i a ~ ip (i.b). In case 
(i.a), we have K^Gf^ ■ ■ ■ Gf^^K*™ ^ = 1, or in case 
(i.b), we have Kff ■ ■ ■ K bin G bin ° • • • K bin , = 1. In words, 
we can bypass the part of the path that merely took y ia to 
itself, leaving a shorter path that still connects yi — > Uk- 

Similarly, if n — n u (ii), then either 3a s.t. j a = k (ii.a), 
or 3a, /3 with a / /J s.t. j a = jp (ii.b). In case (ii.a), we 



have K 



bin 



G 



bin 



2 + + l 



-bin 



haveK-...G b ^^ , 



= 1, or in case (ii.b), we 
K bln , = 1, where we have now 



bypassed the part of the path taking Uj a to itself to leave a 
shorter path. 

We have shown that, V r > n, any non-zero component 
term of x bm (G bm K bm ) r has a corresponding non-zero term 
of strictly lower order, and the result follows. ■ 

We now prove another preliminary lemma showing that the 
optimal solution can be no more sparse than any element of 
the sequence. 

Lemma 4: For Z* £ M nuXUy and the sequence {Z m £ 
B" uXn », m £ N} defined as above, the following holds: 



Z* > Z„ 



m £ N 



(17) 



Proof: First, Z* > Z n = K bm is given by the satisfaction 
of the last constraint of ( |12) , and it just remains to show the 
inductive step. 

Suppose that Z* > Z m for some to e N. It then follows 
that 



ry* I ry* /^rblll ry* ^ ry , ry j^fbin ry 

From the first constraint of (JT2J and |2]i we know that the 
left hand-side is just Z* , and then using the definition of our 
sequence, we get Z* > Z m+ i and this completes the proof. 

■ 

We now give a subsequent lemma, showing that if the 
sequence does converge, then it has converged to the optimal 
solution. 

Lemma 5: If Z m * = Z m * + i for some to* £ N, then Z m - — 
Z*. 

Proof: If Z m * = Z m , + i, then Z m , = Z m , + 
G bm Z m ,, and it follows from ^ that Z m .G bin Z m « < 
. Since Z m+ i > Z m for all to £ N, it also follows that 
> Zq — K bm for all to £ N. Thus the two constrains 
121 are satisfied for Z m *. 



Z, 
Z, 

z, 

of 

Since Z* is the sparsest binary matrix satisfying these 
constraints, it follows that Z* < Z m *. Together with Lemma[4] 
and equation (j3j, it follows that Z m - = Z* , ■ 

We now give the main result: that the sequence converges, 
that it does so in log 2 n steps, and that it achieves the optimal 
solution to our problem. 



Theorem 6: The problem specified in (12i has an unique 
optimal solution Z* satisfying: 

Z m . = Z* (18) 

where to* = [log 2 n\ and where n = min{n„, n y }. 
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Proof: Z m , = J2lZo 1 if bin (G bin A' bin ) s from Lemma [2] 
and then Z m . = J2™Zo K bin {G bin K bin ) s from Lemma [3] since 
2 m * > n. Similarly, Z m * +1 = E^q^ -1 K bin (G bin K hin ) s = 
Es=o K bin (G b ' m K bin ) s , and thus Z m , = Z m * +1 and the result 
follows from Lemma |5] ■ 

a) Delay Superset (Revisited): Suppose again that we 
wish to find the closest superset defined by delay constraints. 
This can be found by convex optimization as described in 



Section V-A It can also be found with the above algorithm, 



where G is replaced with a matrix of the propagation 
delays, K bm with the given transmission delays, and where the 
binary algebra is replaced with the (min, +) algebra. The Z m 
matrices then hold the transmission delays at each iteration, 
and with the appropriate inequalities flipped (since finding a 
superset means decreasing transmission delays), the proofs 
of the lemmas and the convergence theorem follow almost 
identically. 

2) Sparsity Subset: We now notice an interesting asymme- 
try. For the case of delay constraints, if we were interested in 
finding the most restrictive superset (for a lower bound), or the 
least restrictive subset (for an upper bound), we simply flipped 
the sign of our final constraint, and the problem was convex 
either way. When we instead consider sparsity constraints, the 
binary constraint ruins the convexity, but we see that in the 
former (superset) case we can still find the closest constraint 
in a fixed number of iterations in polynomial time; however, 
for the latter (subset) case, there is no clear way to "flip" the 
algorithm. 

This can be understood as follows. If there exist indeces 
i,j,k,l such that = G b f = K b £ = 1, but K%f = 0; 
that is, indeces for which condition {8) fails, then the above 
algorithm resets K b f — 1. In other words, if there is an 
indirect connection from yi — > u^, but not a direct connection, 
it hooks up the direct connection. 

But now consider what happens if we try to develop an 
algorithm that goes in the other direction, that finds the least 
sparse constraint set which is more sparse than the original. 
If we again have indeces for which condition ([8]) fails, then 
we need to disconnect the indirect connection, but it's not 
clear if we should set K bl " or K b ™ to zero, since we could 
do either. The goal is, in principle, to disconnect the link that 
will ultimately lead to having to make the fewest subsequent 
disconnections, so that we end up with the closest possible 
constraint set to the original. 

We suggest some methods for dealing with this problem. 
It is likely that they can be greatly improved upon, but are 
meant as a first cut at a reasonable polynomial time algorithm 
to find a close sparse subset. 

For the first heuristic, we set up transmission delays and 
propagation delays as in |9]) and ( |10) , and then instead of 
adding the binary constraint and making the problem non- 
convex, add the relaxed constraint < t^i < R for all k, I, 
and solve the resulting convex problem. Then, for a set of 
indeces violating condition (|8), set K bl " to zero if t* ki > t* l7 
and set K b ™ to zero otherwise, before re-solving the convex 
problem. The motivation is that we disconnect the one that 
has a larger delay, that is, which is more constrained, in the 



case where we allowed varying degrees of constraint. 

The relaxed problem could instead be solved with increasing 
penalties on the entropy of vec(t/R), to approach a binary 
solution, as in the study of probability collectives fTU) . This 
method has the benefit that it could be used to find a close 
sparse set or subset. 

For the second heuristic, we more directly keep track of how 
many indirect connections are associated with a direct connec- 
tion. Define this weight as w kl = K k? G *7 K *? 
thus giving the amount of 3-hop connections from yi — > Uk- 
This is a crude measure of how many subsequent disconnec- 
tions we will have to make to obtain quadratic invariance if 
we were to disconnect a direct path from yi — > u^. Then, 
given indeces for which condition ([H} is violated, we set K^f 
to zero if Wki < Wji, and set K b \ n to zero otherwise. 

Note that for either heuristic, we have many options for 
how often to reset the guiding variables, that is, to re-solve the 
convex program or recalculate the weights, such as after each 
disconnection, or after each pass through all n u n y indeces. 

It has been noticed that some of the quadratically invariant 
constraints for certain classes of problems, including sparsity, 
may be thought of as partially ordered sets fTT) . This raises 
the possibililty that work in that area, such as fl2) , may be 
leveraged to more efficiently find the closest sparse sets or 
subsets. 

VI. Nonlinear Time- Varying Control 



It was shown in |T3) that if we consider the design of 
possibly nonlinear, possibly time-varying (but still causal) con- 
trollers to stabilize possibly nonlinear, possibly time-varying 
(but still causal) plants, then while the quadratic invariance 
results no longer hold, the following condition 

K X (I ± GK 2 ) € S for all K 1 ,K 2 eS 

similarly allows for a convex parameterization of all stabilizing 
controllers subject to the given constraint. 

This condition is equivalent to quadratic invariance when S 
is defined by delay constraints or by sparsity constraints, and 
so the algorithms in this paper may also be used to find the 
closest constraint for which this is achieved. 

VII. Numerical Examples 

We present some numerical examples of the algorithms 
developed in this paper. 

A. Example - Sparsity Constraints 

We start this section by finding the closest quadratically in- 
variant superset, with respect to the following sparsity patterns 
of two plants with four subsystems each (n = 4): 



-.bin 



10 
110 
111 
1 



G 



bin 



10 
110 
110 
11 



(19) 



The first sparsity pattern in ( fl9) i represents a plant where 
the first two control inputs effect not only their own subsys- 
tems, but also the subsequent subsystems, and where the last 
control input effects not only its own subsystem, but also the 



7 



preceding subsystem. The second sparsity pattern represents 
a plant where each control input effects its own subsystem 
and the subsequent subsystem, which also corresponds to 
the open daisy-chain configuration. Now consider an initial 
proscribed controller configuration where the controller for 
each subsystem has access only to the measurement from its 
own subsystem: 



K 



bin 



(20) 



that is, where the controller is block diagonal. Using the 



algorithm specified in ( 13 1-( 14 1 we arrive at 



10 
110 

1111 

1 



10 
110 
1110 

1111 



(21) 



where Z*j and Z* ll denote the optimal solution of ( 12 1 as 



applied to Gj and Gj", respectively, and thus represent 
the sparsity constraints of the closest quadratically invariant 
supersets of the set of block diagonal controllers. We see that 
a quadratically invariant set of controllers for the first plant 
(which contains all block diagonal controllers) has to have 
the same sparsity pattern as the plant, and an additional link 
from the first measurement to the third controller. We then 
see that any quadratically invariant set for the open daisy- 
chain configuration which contains the diagonal will have to 
be lower triangular. 

B. Example - Delay Constraints 

We consider n = 4 subsystems, with the following given 
propagation delays and the following proscribed transmission 
delays, all chosen as random uniform integers from to 9: 



6 5 

2 9 



8 5 



We then display in Table [I] the difference between the delays 
of the closest quadratically invariant subset, set, and superset 
from the given transmission delays (t — t), as measured in the 
vector 1-norm, 2-norm, and oo-norm. These were computed 



by solving the convex problem of Section V-A which was 



done in Matlab using the CVX package 1 14], and verified using 
linprog ( ) for the 1-norm and oo-norm. 

The delays have to be increased to reach the closest QI sub- 
sets, so the first column contains only nonnegative numbers, 
and the delays are decreased to get to the closest supersets, 
so the last column contains only nonpositive numbers, and the 
delays may be moved in either direction to get to the closest 
QI set in the middle column. Finding the closest QI superset 
is actually the same in any norm, as each delay between a 
given measurement and control action is set to the fastest 
indirect delay between those two signals. We indeed see that 
the superset is the same for the 1-norm and 2-norm. This same 
set of delays would also solve the problem for the oo-norm, 
but it has selected a matrix with some smaller delays, with the 
same maximum change of 4. This shows the problem with 
the lack of uniquness that often arises when optimizing the 



oo-norm: it is indifferent to further moving the delays that 
have not been moved the maximum amount. Thus it should 
never be used to find the closest superset, and when it is 
appropriate to control it in finding a closest set or subset, it 
should be used in conjunction with another norm as well. We 
see that this example produces the same level of sparsity in 
the delay differences to closest subset and set for the 1-norm 
and 2-norm, though minimizing the 1-norm generally produces 
sparse solutions p3| , and should be the norm to choose here 
when one wishes to alter as few of the delays as necessary. 
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VIII. Conclusions 

The overarching goal of this paper is the design of lin- 
ear time-invariant, decentralized controllers for plants com- 
prising dynamically coupled subsystems. Given pre-selected 
constraints on the controller which capture the decentralization 
being imposed, we addressed the question of finding the 
closest constraint which is quadratically invariant under the 
plant. Problems subject to such constraints are amenable to 
convex synthesis, so this is important for bounding the optimal 
solution to the original problem. 

We focused on two particular classes of this problem. The 
first is where the decentralization imposed on the controller is 
specified by delay constraints; that is, information is passed 
between subsystems with some given delays, represented by a 
matrix of transmission delays. The second is where the decen- 
tralization imposed on the controller is specified by sparsity 
constraints; that is, each controller can access information from 
some subsystems but not others, and this is represented by a 
binary matrix. 

For the delay constraints, we showed that finding the closest 
quadratically invariant constraint can be set up as a convex 
optimization problem. We further showed that finding the 
closest superset; that is, the closest set that is less restrictive 
than the pre-selected one, to get lower bounds on the original 
problem, is also a convex problem, as is finding the closest 
subset. 

For the sparsity constraints, the convexity is lost, but we 
provided an algorithm which is guaranteed to give the closest 
quadratically invariant superset in at most log 2 n iterations, 
where n is the number of subsystems. We also discussed 
methods to give close quadratically invariant subsets. 
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